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1  Summary 

The  PI  feels  that  the  work  under  the  grant  achieved  great  progress  in  settUng  important  open 
questions  (for  instance,  the  complete  characterization  of  the  “input  to  state  stabihty  Poverty) 
as  well  as  in  making  substantial  advances  towards  the  solution  of  many  other  problems, 
sides  the  publication  record,  evidence  of  success  is  provided  by  the  large  number  of  researchers 
who  are  now  pursuing  applications  (including  in  some  cases  numeric^  implementations  of  al¬ 
gorithms)  as  well  as  theoretical  extensions  of  the  results  of  work  performed  under  this  grant. 
Formal  recognition  of  the  work  reported  here  includes  several  invitations  to  give  plenary  talks 
at  major  conferences,  as  weU  as  an  invited  presentation  at  the  1994  International  Congress  of 
Mathematics,  and  the  elevation  of  the  PI  to  a  Fellow  of  the  Institute  of  Electromc  and  Electrical 

Engineers. 

The  topics  to  be  discussed  are  aU  interrelated;  the  common  denominator  is  the  focus  on 
nonlinear  control.  They  can  be  organized  roughly  into  these  broad  categories; 


•  Stabilization 

-  State-Space  Stabilization 

-  Input/Output  Stabilization;  Feedback  Equivalence 

-  Partial-State  and  Set  Stability 

-  Classical  Operator-Theoretic  Stability  Notions 

•  Control- Lyapunov  Functions 

-  Constrained  Control- Value  Sets  and  Parametric  Versions 
—  Nonsmooth  Case 

•  Numerical  Methods  for  Steering 


•  Other  Areas 

-  Discrete-Time  Control  and  Dynamical  Systems 

-  I/O  Equations  and  Identification  Questions 


The  rest  of  this  Introduction  wiU  briefly  outUne  the  above  areas.  More  det^  are  provided  in 
later  sections.  Most  of  the  discussion  in  this  report  will  be  informal,  with  references  to  the  PI  s 
publications  for  detailed  technical  points. 


Stabilization 

The  main  objective  of  control  is  to  modify  the  behavior  of  a  dynamical  system,  typi^y  ^ 
the  purpose  of  regulating  certain  variables  or  tracking  desired  signals.  Often,  stabthty  of  the 
closed-loop  system  either  is  an  expUcit  requirement  or  else  the  problem  can  be  recast  in  a  fom 
that  involL  stabiHzation  (e.g.,  of  an  error  signal).  For  linear  systems,  the  associated  problems 
can  now  be  treated  fairly  satisfactorily,  but  in  the  nonlinear  case  the  area  is  still  far  ^e  g 
settled.  In  fact,  both  of  the  late  1980s  reports  ‘Challenges  to  control:  A  coUective  view  and 
“Future  Directions  in  Control  Theory:  A  Mathematical  Perspective”  identified  the  problem  of 
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stabiUzation  of  fimte-dimensional  deterministic  systems  as  basically  the  most  important  open 
problem  in  nonlinear  control. 

One  of  the  main  goals  of  this  work  was  to  deal  with  issues  of  stabilization  in  its  two  vari¬ 
ants:  state-space  and  input/state  (ISS)  (or  more  gener^y  input/output)  stability  The  former 
term  refers  to  the  asymptotic  stability  of  equilibria  in  the  absence  of  (or  subject  to  oMy  small) 
external  “disturbance”  inputs.  On  the  other  hand,  the  latter  term  refers  to  various  "mathemat¬ 
ical  definitions  aU  of  which  focus  on  bounds  on  state  trajectories  expressed  in  terms  of  bound 
on  forcing  functions.  Mathematically,  state-space  stabiUzation  relates  to  classical  dynamical 
systems  ideas;  in  many  practical  situations,  it  can  be  achieved  by  means  of  hnearization  un 

der  feedback  (Brockett,  Hunt,  Meyer,  Su,  Jakubczyk,  or 

(Artstein  Jurdjevic-Quinn,  Tsinias),  via  the  study  of  zero-dynamics  (Byrnes  and  Isidori)  or, 
for  more  local  studies,  through  Center  Manifold  Techniques  (Abed,  Aeyels  Bacciotti,  B^t^y 
Marino,  Crouch,  and  many  others).  Input/output  stabUity,  in  contrast,  has  classically  had  a 
more  operator-theoretic  flavor  and  developed  independently,  often  using  techmques  based  on 
small-gain  arguments  (Desoer,  Sandberg,  Vidyasagar,  Zames,  and  others). 

Based  on  Unear  systems  intuition,  where  all  notions  coincide,  it  is  Pe^aps  surprising  that 
state-space  and  i/o  stabiUty  are  not  automaticaUy  related.  Even  for  feedback  Unearizable 
svsteml  lUs  relation  is  more  subtle  than  might  appear:  it  one  first  linearizes  a  system  and  then 
siabUizes  the  equivalent  linearization,  in  terms  of  the  original  system  one  does  not  m  general 
obtain  a  closed-loop  system  that  is  input/output  stable  in  any  reasonable  sense.  However 
and  this  has  been  the  point  of  some  of  the  Pi’s  research  starting  with  a  ”  *te  1989 

Transactions  in  Automatic  Control,  it  is  always  possible  to  make  a  choice  of  a 
feedback  law  that  achieves  such  stability,  in  the  Unearizable  case  as  wcU  as  for  all  other  smoothly 

stabiUzable  systems. 

Recent  work  of  the  PI  and  his  students  have  dealt  with  versions  of  these  results  for  robust 
StabiUty,  as  weU  as  design  techniques  that  apply  to  output  stabihzat.on  problems  and  to  the 
construction  of  observers.  The  unifying  framework  is  that  of  stabihzat.on  (both  in  the  state 
and  i/o  sense)  with  respect  to  arbitrary  (typically  noncompact)  invariant  sets.  In 
Lyapunov-Uke  characterizations  are  very  useful,  and  form  the  basis  of  appbcat.ons  o  the  Pis 
work  in  robust  and  adaptive  control  (e.g.,  in  recent  work  by  Praly  and  Teel,  Kokotovic  and 
Fre6ina.li,  Tsinias,  and  others). 

One  of  the  main  achievements  of  the  project  was  in  deriving  a  new  converse  Lyapunov 
Theorem  in  for  robust  stabiUty  ([11|,  with  former  students  Lin  and  Wang)  and  m  the 
of  this  to  obtaining  complete  characterizations  ol  the  ISS  property.  In  the  o-appea  paper  [101 
with  Wang,  we  were  able  to  show  that  the  ISS  property  is  in  fact  equivalent  to  the  existence 
of  a  nontrivial  nonUnear  stabiUty  maegin,  as  weU  as  to  a  natural  charactenzat.on  m  terms 
of  dissipation  inequaUtles  (connecting  this  work  to  so-called  ^onhne^r  jl  work  “d  jdso 
solving  an  important  and  longstanding  open  problem,  that  ISS  stabiUty  is  equivalent  to  the 
existence  of  an  ISS-Lyapunov  function. 


Control-Lyapunov  Functions 

A  basic  problem  in  leedback  control  theory  -which  also  arises  in  many  other  areas;  for  instance 
it  is  known  as  the  “credit  assignment  problem”  in  artificial  intelhgence-  is  that  of  deading  on 
proper  control  actions  at  each  instant  in  view  of  an  overaU,  loPg'l'™;  ““X"'  oo” 

of  a  cumulative  (typicaUy,  integral)  cost  leads  impUcitly  to  such  X^c 

of  the  Lagrangian  or  variational  approach.  Another  possibdity,  which  underhes  the  dynamic 
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programming  paradigm,  is  to  attempt  to  minimize  at  each  mstant  a  quantity  that  measures 
overall  “goodness"  of  a  given  state.  In  optimal  control,  this  quantity  is  known  as  the  e  man 
(or  the  cost-to-go,  or  value,  function);  in  stabilization,  one  talks  ahont  Lyapunov  (or  energy 
functions;  game-playing  programs  use  position  evaluations  (and  subgoals);  in 
faUs  under  the  rubric  of  learning  control,  one  introduces  a  critic.  Roughly  speaking,  aU  these 
are  variants  of  the  same  basic  principle  of  assigning  a  cost  (or,  dually,  an  expectation  of  success 
to  a  given  state  -sometimes  to  a  state  and  a  proposed  action-  in  such  a  way  that  this  cost  is  a 
good  predictor  of  eventual,  long-term,  outcome.  Then,  choosing  the  right  action  reduces  to  a 
simpler,  nondynamic,  pointwise-in-time,  optimization  problem:  choose  a  control  that  leads  to 

a  next  state  with  least  cost. 

FoUowing  ideas  introduced  by  Artstein  and  himself  in  the  early  1980s  the  PI  introduced 
in  1989  a  systematic  methodology  for  the  use  of  such  control- Lyapunov  functions  which  are 
“energy"  functions  that  can  be  made  to  decrease  pointwise  by  means  of  appropriate  instanta¬ 
neous  controls.  (This  work  is  closely  related  to  an  approach  standard  in  practice  -buj  usu^y 
ah-hoc-  to  the  control  of  nonlinear  systems.)  Since  then,  the  “umversal  formulas  derived 
by  the  PI  have  been  widely  applied  by  many  different  authors,  and  are  now  part  of  both  the 
textbook  bv  Bacciotti  on  stabilizabiUty  and  Isidori’s  (Third  Edition  nonhnear  control  booL 
The  research  on  this  topic  by  the  PI  under  this  grant  has  dealt  with  (1)  the  generahza  ion  of  the 
“universal  formulas"  to  cases  of  bounded  controls  (work  joint  with  the  PI  s  g-^uate  studen 
Lin)  and  (2)  the  extension  of  these  formulas  to  the  nondifferentiable  case  (see  [25]).  This  latter 
work  makes  contact  with  several  less-explored  areas,  such  as  the  use  of  viscocity  solutions  an 
nondifferentiable  optimization  in  the  context  of  control- Lyapunov  functions. 

Numerical  Methods  for  Steering 

The  effective  design  of  controls  for  the  steering  of  nonlinear  systems  without  drift  largely 
motivated  by  the  study  of  nonholonomic  mechanical  systems,  has  attracted  much  attention 
during  the  past  few  years.  Many  sophisticated  control  strategies  have  been  Proposed  based  on 
a  nonLial  analysis  of  the  structure  of  the  Lie  algebra  of  vector  fields  generated  by  the  system, 
as  in  work  by  Brockett,  Sastry  and  his  students,  Bloch  and  McClamroch  Sussmann  and  his 
students,  and  many  others.  In  the  recent  work  [22][14],  the  PI  introduced  an  approach  of  an 
entirely  different  nature,  the  “generic  nonsinguiar  loop”  method. 

The  Pi’s  method  is  based  on  a  simple-minded  algorithm,  in  the  style  of  classical  numerical 
methods,  requiring  no  symboUc  computation  to  implement.  Although  fairly  trivial  to  implement 
in  principle,  the  pwof  of  the  general  applicability  of  the  method  is  b^ed  on  not  Jl^te^so- 
trivial  results  asserting  the  genericity  of  nonsingular  controls  and  estabhshing  a  J 
an  observability  problem.  Obviously,  as  with  any  general  procedure,  it  can  be  expected  to  be 
extremely  inefficient,  and  to  result  in  poor  performance,  when  compared  with  t^hmques  that 
use  (when  available)  nontrivial  information  about  the  system  being  controlled.  We  expect  ou 
method  to  be  useful  mainly  in  conjunction  with  other  techmques,  to  provide  a  first  step  of 
global  control,  to  be  followed  by  finer  local  control. 


Discrete-Time  and  Dynamical  Systems 

Modern  control  techniques  typically  result  in  complex  regulation  inechanisms,  which  must  be 
implemented  using  digital  computers.  Consequently,  a  fundamental  area  ^ 

studving  the  constraints  imposed  by  computer  control.  The  behavior  of  continuous-time  plants 
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under  digital  control  can  be  modeled  by  discrete-time  systems.  Starting  in  the  mid-seventies 
in  joint  work  with  Rouchaleau,  the  PI  had  been  interested  in  problems  of  control  for  no^near 

discrete  time  systems,  and  his  Ph.D.  thesis  under  Kalman  was  on  this  topic^  oUabilitv  I 
1980s  the  focus  of  this  work  shifted  largely  to  questions  of  accessibihty  and  controUabihty, 
summary  is  provided  in  the  expository  paper  pubUshed  in  the  January  1990  issue  of  SIA  . 

Control  bv  Jakubczyk  and  the  PI. 

During  the  last  three  years,  in  collaboration  with  graduate  student  Albertini,  who  com¬ 
pleted  her  dissertation  in  mid  1993,  the  PI  extended  and  greatly  improved  many  of  the  basic 
Lults  from  the  work  with  Jakubczyk  regarding  characterizations  of  nonhnear  discrete-time 
controUabilitv.  Two  fairly  major  journal  papers  resulted  from  these  efforts,  as  weU  as  ^  num  er 
of  conference  papers.  Among  other  things,  we  were  able  to  show  that  accessibihty  can  be  ch 
acterized  in  Lie  algebraic  terms,  in  much  the  same  way  as  for  contmuous-tme  systems,  under 
various  dvnamical-system  assumptions  on  unforced  dynamics,  applying  for  instance  to  systems 
arising  through  the  time-sampUng  of  a  Hamiltonian  system.  We  also  extended  to  discrete-time 
systems  some  of  the  basic  results  about  “control  sets”  as  introduced  by  Khemann  and  Colomus 
for  continuous-time  (the  extensions  are  nontrivial,  as  the  basic  enabhng  results  were  not  avail¬ 
able  before  our  work),  and  in  this  way  we  managed  to  establish  a  correspondence,  in  perfect 
analogy  to  their  work,  between  controHabiUty  of  a  given  system  and  chaotic  behavior  of  an 

“extended  system”  associated  to  it. 


I/O  Equations  and  Identification 

We  also  continued  the  investigation  of  relations  between  state-space  realizabiBW  and  equations 
involving  input/output  data,  as  weU  as  the  associated  structural  questions  about  observation 
spaces.  Much  of  this  work  in  the  past  has  been  carried  out  jointly  with  the  PI  s  former  gradua  e 
student  Wang,  and  this  collaboration  is  ongoing  (during  the  last  two  years,  two  major  joint 
joutt  have  appeared,  aad  aao.her  one  has  been  accepted  tor  SIAM  J  Control  on  e 

topic)  It  is  motivated  mostly  by  the  interest  in  nonhnear  identication  algorithms  (most  sue 
algorithms  are  based  on  estabUshing  nonhnear  dependences  among  i/o  data,  and  hence  one 
mLt  ask  when  this  imphes  that  a  state-space  model  can  be  built).  Other  motivations  are  given 
by  the  use  of  these  results  in  understanding  the  connections  between  state-space  theory  a 
WiUems’  school’s  “behavioral”  approach,  as  weU  as  Fhess’  differentiM- algebraic  work  (one  rece^ 
joint  conference  paper  with  Wang  provides  various  theorems  in  that  regard).  A  particularly 
unexpected  and  interesting  result  was  given  in  [27],  which  showed  the  existence  of  inputs  tha 
are  sufficiently  rich  to  permit  the  identification  (in  theory)  of  arbitrary  nonhnear  systems.  Tffis 
result  constitutes  probably  the  ultimate  generahzation  of  “universal  input  theorems  developed 
by  many  during  the  last  20  years  (a  journal  paper  is  in  preparation). 

Next  we  provide  some  more  details  on  the  above  topics. 
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2  State-Space  and  I/O  Stabilization 

A  substantial  part  of  this  work  dealt  with  the  stabilization  of  nonlinear  systems  and  the  effect 
of  input  perturbations,  and  represents  a  long-standing  direction  of  research  pursued  by  the  PL 
4s  discussed  in  the  introduction,  problems  of  stabilization  underlie  most  questions  of  con  rol 
design,  and  many  control  objectives  can  be  recast  in  those  terms.  Therefore  a  great  deal  of 
effort  has  been  directed  towards  the  understanding  of  the  general  problem  of  asymptoticaUy 
stabilizing  systems  of  the  general  form 

X  =  f(x,u)  (^) 


with  respect  to  an  equilibrium  point,  or,  more  generally,  with  respect  to  a  set  of  states  of 
particular  interest.  (States  x{t)  and  inputs  or  controls  u{t)  evolve  in  fimte-dimensional  spaces 
m"  and  IR'"  respectively;  as  usual,  we  do  not  write  the  time-argument  t  in  the  equations 
When  global  stabilization  to  equilibria  is  of  interest,  there  is  no  point  in  studying  more  gener 
svstems  in  manifolds,  since  the  existence  of  a  globally  asymptotically  stable  equihbrium  forces 
the  manifold  to  be  diffeomorphic  to  EucUdean  space.  For  questions  of  stabihzation  with  respec 
to  invariant  sets,  such  as  periodic  orbits,  systems  on  manifolds  are  of  potential  interest.  To  keep 
the  exposition  elementary,  however,  we  restrict  to  states  in  Furtherinore,  we  omit  from 
this  informal  discussion  all  technicalities  regarding  regularity  properties  of  /;  at  least  existence 
and  uniqueness  of  trajectories  for  each  bounded  measurable  control  is  assumed.) 

In  order  to  talk  about  stabihzation,  which  deals  with  closed-loop  behavior,  it  is  first  neces¬ 
sary  to  understand  what  is  meant  by  “stabihty”  of  an  open-loop  system  such  as  (1).  Techni¬ 
calities  aside,  there  are  two  conceptually  very  different  manners  of  defining  this  notion. 


Notions  of  Stability 

The  most  obvious  approach  to  defining  stabihty  of  control  systems  rehes  on  the  standard  Lya¬ 
punov  definition  from  dynamical  systems  theory,  and  is  obtained  when  one  disregards  the 
control.  Assume  that  0  is  an  equihbrium  state,  that  is,  /(0,0)  =  0.  Then  one  simply  requmes 
the  global  asvmptotic  stabihty  of  the  origin  for  the  system  which  is  obtained  by  setting  u  _ 
(More  generahy,  as  discussed  below,  given  a  particular  invariant  set  A  of  interest,  not  necessar¬ 
ily  -4  =  {0},  one  may  want  uniform  asymptotic  stabihty  of  this  set,  again  m  the  standard  sense 
of  dynamical  systems.  Another  variant  is  to  consider  the  corresponding  local  defimtions;  for 
simphcity,  the  Mowing  discussion  wih  be  concerned  only  with  the  global  case.)  This  notion  o 
stabihty  is  often  called  state-space  or  zero-input  stability. 

In  practice,  control  systems  are  affected  by  noise,  expressed  for  instance  as  disturbances, 
actuator  perturbations,  and  errors  on  observations.  In  this  context,  it  is  desirable  for  a  system 
to  display  so-cahed  “input/state”  stabihty  properties.  This  leads  to  the  conceptual  alterna  ive 
of  defining  stabihty  for  (1)  in  an  operator-theoretic  sense.  What  is  desired  is  not  (only)  that  the 
system  be  zero-input  stable  as  described  above,  but  that,  in  addition,  a  bounded  or  decaying 
input  u(-)  should  produce  a  similarly-behaved  state  trajectory  i(-). 

For  suitablv  “small”  inputs,  this  is  often  a  consequence,  and  hence  not  different  conceptually 
from,  state-stabihty;  much  of  the  huge  classical  hterature  on  total  stabihty  -Lefschetz  c^d  this 
“quasi-stabihty”-  deals  with  such  issues.  But  often  one  is  interested  in  quantifying  the  effect 
of  relatively  “large”  inputs.  That  is,  one  wishes  to  impose  regularity  (contmmty,  boundedness, 

etc)  properties  on  the  operator 
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(initial  state.control)  h-  ensuing  complete  state  trajectory. 

This  input/output  (if  only  partial  observations  are  of  interest)  or  input/state  stability  is  central 
to  the  study  of  robustness  with  respect  to  actuator  and  sensor  noise,  as  weU  as  being  the  basis 
of  approaches  to  controller  parameterization. 

Given  the  above  intuitive  description,  there  are  many  possible  precise  mathematics  delim- 
tions  of  input/output  stabUity.  One  possibility  is  to  simply  add  the  requirement  5755:  bounded 
inputs  should  produce  bounded  state  trajectories  (or  more  generally  state  trajectories  that  stay 
within  a  bounded  distance  of  a  desired  invariant  set  .4).  Even  here,  there  are  variants.  e 
state  bounds  may  be  required  to  depend  only  on  input  and  imtial  state  bounds  bjt  ^ot  on 
the  actuS  vSues  of  thes^  and  this  dependence  can  expected  to  be  hnear,  such  a  defimti  , 
amounting  to  boundedness  of  an  operator,  gives  rise  to  “fimte-gain  stabihty  (  fimte  incremen¬ 
ts  gSn”  if  the  operator  is  to  be  Sso  Lipschitz);  see  the  discussion  below  on  operator  stabSty 
for  Lurated-control  systems.  Variants  of  the  BIBS  property  are  based  on  5  norms  instead  of 
sup  norms.  Another  possibility  is  to  impose  the  condition  CICS:  convergent  (to  zero)  inputs 
shoSd  produce  convergent  (to  the  desired  equilibrium  point  or  set  A)  state  trajectories. 

The  possibiUties  for  i/o  stabihty  are  many;  the  important  issue  is  to  provide  a  definition 
which  (1)  is  potentiaUy  useful  in  practical  apphcations  and  general  enough  and  (2)  leads  itsell 
to  nontrivial  positive  results.  In  the  late  1980s,  the  PI  introduced  in  a  IEEE  TAG  paper  a 
particular  precise  definition  of  input/state  stability,  or  as  it  has  since  become  known,  Ibb 
stabihty.  The  definition  is  reviewed  in  an  appendix  to  this  section,  but  it  is 
discussion  to  foUow  ;  essentiaUy  it  encompasses  in  one  simple  estimate  both  of  BIBS  and  CIGb 
stabihty  as  weU  as  an  ultimate  boundedness  property.  Since  its  introductmn,  it  and  its  obvious 
variants  to  deal  with  outputs  (many  of  which  were  also  described  in  the  original  reference  an  in 
Lin’s  Ph.D.  thesis  under  the  PI  in  1992)  have  been  the  focus  of  several  papers  by  many  authors, 
just  as  examples  one  may  cite  the  apphcations  to  observer  design  and  new  small-gam  thorns 
in  by  Tsinias,  Jiang,  Praly,  Teel,  Freeman,  Kokotovic,  and  others.  An  expository  introduction 

to  the  topic  can  be  found  in  [16]. 


Feedback  Equivalence  to  ISS 

We  aext  fflttstrate  expUcitly  one  of  many  ways  in  which  the  ISS  definition  is  useful  and  natural. 
Since  much  recent  research  in  nonlinear  control  has  been  directed  towards  the 
of  techniques  for  state-space  stabilization,  the  relation  between  state  space  and  i/o  stabdity 
is  of  sreat  interest.  However  -contrary  to  the  situation  that  holds  for  hneM  systems-  stat^ 
space  stability  does  not  in  general  imply  i/o  stability.  This  is  evidenced  by  the  trivial  example 
i  =  -I  +  UI^  with  m=n=l;  the  system  is  zero-input  stable  but  u(t)  =  1  maies  every  trajectory 
with  z(0)  >  1  escape  to  infinity  in  finite  time.  Given  that  the  two  broad  notions  of  stability  do 
not  inynetal  coincide,  it  makes  sense  to  ask  the  design  questioni  H  one  can  make  a  system 
state-space  stable  by  using  feedback,  can  one  also  make  it  l/o  stabk?  Mathematicany  the 
stabilization  problem  is  that  of  finding  a  fe^back  transformation  of  the  type  u  =  +  I3{x)v 

SO  that  the  system  with  new  control  v  €  E-”’ 

X  =  F(x,v)  =  f(x,k(x)  +  P{x)v)  (2) 

is  stable  in  the  desired  sense.  The  new  “closed-loop”  system  (2)  is  said  to  be  "j 

to  the  original  one;  the  square  matrix  «x)  is  required  to  be  invertible  to  all  X  ^ 
instantaneous  controUability  is  lost  (as  usual  in  nonlinear  feedback  eqmvalence).  Note  that 
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the  more  restricted  problem  of  state-space  stabilization  is  that  of  finding  just  k  (.s  /3  is  now 

irrelevant)  so  that  with  respect  to  the  origin  (or  a  given  invariant  f 

with  v  =  0,x  =  F(x,0)  =  f(x,k(x)),  be  globaUy  asymptoticaUy  stable;  for  i/o  stabihty  one 

wants  that  (2)  be  i/o  stable. 

It  is  perhaps  surprising,  given  the  gap  between  the  two  properties,  that  if  a  system  is 
stabilizable  in  the  state-space  sense  then  it  is  also  stabilizable  in  the  i/o  sense,  n  o  er  wor  s, 
from  a  differential  equations  viewpoint,  the  properties  are  very  different,  but  from  a  control 
viewpoint  they  are  equivalent  modulo  the  standard  group  of  feedback  transformations  To  be 
more  precise,  they  become  equivalent  properties  when  one  uses  the  PI  s  notion  of  ISS  stabihty. 
If  there  is  a  smooth  k  so  that  for  x  =  f  (x,  k{x))  the  origin  is  globally  asymptotically  stable  then 
there  are  also  a  (generally  different)  smooth  k  and  an  invertible  (3  so  that  (2)  is  ISS.  Moreover, 
for  systems  affine  in  controls,  that  is,  those  of  the  special  form 

X  =  f{x,u)  =  /o(^)  +  G{x)u,  (3) 

one  may  take  f3  as  the  identity,  resulting  in  a  feedback  law  which  is  robust  to  input  perturbations. 
(Systems  affine  in  controls,  possibly  with  control  bounds,  cover  most  interesting  aerospace  fimte- 
dimensional  control  appUcations.)  For  stability  with  respect  to  sets,  and  for  parametric  versions 
with  applications  in  robust  control,  this  result  has  now  been  generahzed,  in  Lin  s  thesis  and 

further  in  [7],  as  mentioned  below. 

Perhaps  more  than  the  result  itself,  we  view  this  equivalence  as  one  more  indication  of  the 
aaturaJity  aad  usefulness  of  the  technical  concept  of  ISS;  other  deiimtions  are  not  conductve  to 
simUar  results.  Several  very  recent  equivalent  characterizations  (see  below)  m  terns  of  nonhnear 
stability  margins  and  Lyapunov  functions  reinforce  this  view  Further,  smce  the  ISS  property 
is  weU-behaved  under  cascade  interconnections,  it  is  especially  suited  as  a  systematic  tool  for 

the  design  of  controllers. 


Set  Stability 

Yuandan  Lin’s  doctoral  thesis,  supported  under  this  grant,  and  related  papers,  dealt  with 
stabilization  with  respect  to  (not  necessarUy  compact)  sets.  In  this  we  were  motivated  by 
potential  applications  to  a  wide  variety  of  areas. 

As  an  illustration,  consider  problems  of  output  feedback.  One  common  definition  of 
“detectabffity”  (e.g.  as  done  in  the  work  of  Vidyasagar)  involves  the  existence  of  an  ob¬ 
server  for  which  the  error  satisfies  Lyapunov  estimates  which  depend  only  on  the  difference 
l|x(t)  -  z(t)\\,  where  x(t)  is  the  state  of  the  plant  and  z{t)  is  the  state  of  the  observer,  or 
the  joint  plant/observer  system,  detectability  becomes  stabilization  with  respect  to  the  set 

^  '  ffi^llherap^plications,  one  is  interested  in  stabilization  of  an  output  variable  as  opposed 
to  the  complete  state;  this  happens  for  instance  in  tracking  or  regulation  problems,  where  the 
“output”  is  the  error  in  a  variable  to  be  regulated,  and  the  system  model  may  have  been  enl^ged 
to  iZlude  an  exosystem  generating  disturbances  or  reference  trajectories.  Qualitat^ively,  things 
are  very  different  from  the  fuU  state  case.  Even  local  results,  typically  not  an  obstruction 
the  latter  case,  become  false.  For  example,  consider  the  foUowing  two-dimensional  system: 

X  =  X,  y  =  —y  +  ux, 

with  the  variable  y  taken  as  the  output.  Observe  that  when  «  =  0  the  y  variable  converges 
exponentially  to  zero,  unitormly  on  the  initial  state  (i(0),  s(0)).  However,  for  nonzero  «,  no 
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matter  how  small,  the  output  diverges  if  x(0)  #  0.  This  is  in  marked  contrast  to  the  case  of  state- 
space  stability,  where  at  least  for  smaU  controls  and  smaU  initial  states,  bounded  states  result  if 
the  system  was  asymptotically  stable  for  u  =  0,  and  shows  the  fundamental  difference  with  the 
compact  attractor  case.  (Similar  examples  are  typicaUy  given  to  lUustrate  the  nonrobustness  o 
some  adaptive  control  algorithms;  mathematically,  one  is  dealing  with  almost  the  same  issue. 
Thus  it  becomes  of  interest  to  try  to  make  output  variables  ISS  stable  under  perhaps  aditional 
feedback.  This  corresponds  to  ISS  stability  with  respect  to  a  set,  in  this  example,  the  set  where 

^  Another  motivation  arises  in  robust  control,  where  one  studies  in  effect  stabUity  of  a  control 
system  with  respect  to  the  set  A  :=  {(0,  A),  A  6  A},  where  A  is  the  vector  of  unknown  parameters 
and  “0”  stands  for  the  zero  state.  As  yet  another  motivation,  systems  m  which  derivatives  of 
controls  appear  can  be  reduced,  adding  integrators,  to  systems  in  which  such  derivatives  do  not 
appear,  but  at  the  cost  of  extra  state  variables  which  are  not  to  be  controUed. 

The  paper  [20],  and  related  papers  with  Lin,  concentrated  on  some  basic  questions  related 
to  set  stability.  We  were  able  to  extend  the  validity  of  many  of  the  results  previously  known 
onlv  for  equilibria,  such  as  the  theorem  on  feedback  equivalence  to  ISS  systems.  For  instance, 
from  this  theory  it  is  immediate  how  to  modify  by  feedback  the  system  x  =  =  -y  +  nx 

mentioned  above,  so  that  the  output  satisfies  an  ISS-Uke  property  with  respect  to  u  (see  [20 
(Of  course,  this  can  be  solved  directly  as  weU,  for  this  simple  example  but  the  results  are  in  full 
generality.)  Several  appUcations  to  robust  control  and  to  general  problems  of  output  regulation 

were  given  in  the  work  with  Lin. 

At  the  core  of  the  work  with  Lin  was  a  converse  Lyapunov  theorem  that  does  not  assume 
compactness  of  the  attracting  set.  Far  more  general  is  our  (the  PI,  Lin,  and  Wang)  paper  [11]. 
There,  motivated  by  problems  of  robust  nonlinear  stabilization,  we  gave  a  Converse  Lyapuno 
Function  Theorem  which  is  in  a  form  particularly  useful  for  the  study  of  such  feedback  control 
analysis  and  design  problems.  We  provided  a  single  (and  natural)  umfied  result  W 

appUes  to  stabiUty  with  respect  to  not  necessarUy  compact  invariant  sets,  (2)  de^s  with  glo 
asymptotic  stabUity;  (3)  results  in  smooth  (infinitely  differentiable)  Lyapunov  functions;  and 
most  importantly,  (4)  appUes  to  stabUity  in  the  presence  of  bounded  disturbances  acting  on 

system. 

Questions  of  stabiUty  for  systems  with  disturbances  are  naturaUy  modeled  as  problems  o 
StabUity  for  differential  inclusions.  In  that  context,  classical  books  such^  Aubin  and  CeUina  s 
deal  with  Lyapunov  functions,  but  mostly  in  the  role  of  providing  sufficient  conditions  (one 
exception  is  the  work  in  by  Molchanov  for  the  Unear  case).  Our  converse  Lyapunov  theorem 
can  be  restated  in  terms  of  differential  inclusions,  of  course.  But  the  conditions  of  apphcabUity 
are  different  than  the  conditions  usually  found  in  that  context,  and  in  partic  ar  ey  may 
not  be  satisfied  in  many  examples  of  interest,  including  many  nonsmooth-control  problems.  It 
is  quite  Ukely  that  the  results  wiU  indeed  generalize,  but  mathematically  the  proofs  are  qmte 
deUcate  and  need  considerable  work. 


Characterizations  of  ISS 

One  of  the  main  appUcations  of  our  converse  Lyapunov  theorem  was  in  obtaining 
characterizations  of  the  ISS  property.  In  the  paper  [10]  we  were  aWe  to  show^that  the  ISS 
property  is  in  fact  equivalent  to  the  existence  of  a  “nonhnear  stabUity  margin.  By  this  we 
mean  a  iC^o  function  p  with  the  property  that  for  each  (possibly  nonhnear 
feedback  law  bounded  by  p  (|A:(t,OI  <  P(l^l))»  ^he  closed-loop  system  x  -  f{x,k{t,x)) 
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'  fflobaUv  asymptotically  stable,  with  bounds  uniform  on  k.  Note  that  this  is  not  a  notion  of 
local  stabiUty  with  respect  to  “small”  perturbations.  It  is  a  global  notion,  and  perturbations 
can  be  arbitrarily  large  (since  the  function  p  is  in  class  /C^).  In  some  sense,  this  is  analogous  to 
exponential  stabiUty  for  Unear  systems,  where  a  perturbation  of  the  spectrum  preserves  glob 
asymptotic  stabiUty.  We  also  proved,  solving  an  important  and  longstanding  open  problem, 
that  ISS  StabiUty  is  equivalent  to  the  existence  of  an  ISS-Lyapunov  function. 


Classical  Operator-Theoretic  Notions 

The  notion  of  ISS  was  introduced  in  order  to  model  i/o  stabUity.  Of  course,  ideaUy  one  woidd 
Uke  to  be  able  to  obtain  much  stronger  conditions.  For  instance,  if  the  inputs  are  assumed  to  be 
integrable,  one  may  ask  that  the  input/state  operator  define  a  map  into  the  space  of  integrable 
functions  (of  time)  with  values  in  IR".  Moreover,  one  may  want  this  map  to  be  bounded  or  to 
satisfy  other  typical  functional-analytic  properties.  If  such  stronger  properties  hold,  one  then 
can  study  stabiUty  problems  by  means  of  Banach  space  or  (for  instance  for  square  integrable 
controls)  HUbert  space  techniques.  Classical  approaches  (WiUems,  Desoer,  Vidyasagar)  indeed 
proceed  in  this  fashion.  More  recent  work  such  as  that  represented  by  Georgiou  and  Smith,  then 
aUows  the  appUcation  of  powerful  geometric  notions  (gap  metric  and  so  forth)  to  understand 
robustness  questions.  Related  to  this  is  also  the  so-called  “nonUnear  work  on  mimmizing 

L2  norms  of  feedback  interconnections. 

In  general,  as  mentioned  earUer,  it  appears  that  it  is  not  possible  to  strengthen  the  ISS 
conclusions  of  theorems  such  as  the  one  on  feedback  equivalence  to  attain  bounded  operator 
norms.  However,  in  one  particular  but  stiU  very  important  case,  a  special  class  of  Unear  systems 
subject  to  actuator  saturation,  we  were  able  to  solve  this  problem,  in  recent  work  with  Liu  and 
Chitour;  see  [23]  for  preUminary  results  and  [12]  for  the  final  version.  We  showed  there  how 
to  obtain  StabiUty  with  respect  to  measurement  and  actuator  noise,  for  the  cl^s  of  systems 
(F)x  =  Ax  -I-  Bs(u),y  =  Cx  having  the  pair  (A,B)  controUable,  A  neutraUy  stable,  and 
A,C)  observable,  where  s  is  a  saturation  type  of  nonUnearity.  Specifically,  we  provided  a 
Unear  controUer  C  so  that  the  operator  (wi,U2)  ^  defined  by  the  standard  systems 

interconnection  (see  Figure)  is  weU-posed  and  finite-gain  stable  (with  respect  to  any  Lp  norm, 
1  <  p  <  00).  Our  work  relates  to,  but  is  essentially  independent  of,  other  papers  on  computing 


Figure  1:  Standard  Closed- Loop 

norms  for  nonUnear  systems  in  state  space  form,  as  done  by  van  der  Schaft,  Isidori,  Helton, 
and  others.  The  proof  reUes  upon  techniques  from  dissipative  systems  theory,  but  the  storage 
functions  that  we  need  to  use  are  apparently  completely  new  (in  fact,  they  are  not  even  smooth 
contrary  to  usual  energy  functions).  Motivated  by  our  results,  Saberi,  Lm,  and  Teel  have  just 
obtained  related  ones  for  “semi-global”  stabiUty  for  the  same  class  of  systems.  Ainong  many 
problems  suggested  by  this  work,  one  of  the  most  natural  ones  mathematicaUy  is  the  s  udy  of 
other  properties  (Lipschitz  continuity,  differentiabiUty)  for  the  operators  m  question.  A  air  y 
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complete  understanding  of  these  aspects  was  achieved  towards  the  end  of  the  grant  period,  in 
[30]-[13]. 


Appendix:  Definition  of  ISS 


Recall  that  a  function  7  :  ®->o  —  IR>o  is:  a  IC-function  if  it  is  continuous,  stnctly  increasing 
and  7(0)  =  0;  a  fC^-function  if  it  is  a  /C-function  and  also  7(5)  ^  ^ 

definite  function  if  i{s)  >  0  for  ail  s  >  0,  and  7(0)  =  0.  A  function  /3  :  lR>o  x  lR>o  --  IR>o 
is  a  ICC-function  if:  for  each  fixed  t  >  0  the  function  /?(•,  t)  is  a  /C-function,  and  for  each  fixed 
s  >  0  it  is  decreasing  to  zero  as  t  00. 

We  deal  with  nonlinear  systems 

i  =  fix,  u)  (4) 

where  /  :  R"  x  H”'  — ^  R”  is  continuously  differentiable  and  satisfies  /(O,  0)  =  0.  Controls 
or  inputs  are  measurable  locaUy  essentially  bounded  functions  u  :  R>o  ^  The  set  of  all 
such  functions,  endowed  with  the  (essential)  supremum  norm  \\u\\  =  sup{ln(t)l  ,t  <  00,  is 
denoted  by  LZ-  (Everywhere,  I*!  denotes  the  usual  EucUdian  norm.)  For  each  ^  G  ^ 

denote  by  i(t,  u)  the  trajectory  of  the  system  (4)  with  imtial  state  1(0)  -  ^  and 

the  input  u.  This  is  defined  on  some  maximal  interval  [0,  T^,u),  with  <  +00. 

The  following  definition  is  intended  as  a  nonlinear  generalization  of  the  bound  |x(0l  < 
1^1  +  c||n||  which  holds  for  Unear  systems  i  =  Ax  +  Bu  when  the  matrix  A  is  asymptotically 

stable. 


Definition  2.1  The  system  (4)  is  (globally)  input/state  stable  (ISS)  if  there  exist  a  X:£-function 
(5  :  R>o  X  R>o  — ‘  and  a  /C-function  7,  such  that,  for  each  input  u  e  and  each  ^  €  , 


it  holds  that 


|x(t,^,  u)|  <  /3(|ei,0+7(lln||) 


(5) 


for  each  t  >  0. 


□ 


When  there  is  no  control,  that  is,  we  are  considering  an  estimate  lx(f,^,u)l  <  this 

is  exactly  the  same  as  the  classical  Lyapunov  global  asymptotic  stabiUty  notion  (it  is  not  a 
difficult  exercise  to  show  the  equivalence). 

The  next  definition  states  that  there  is  a  proper  (that  is,  what  is  sometirnes  called  radially 
unbounded)  positive  definite  function  V  on  states  with  the  property  that  its  derivative  V  along 
trajectories  is  negative  definite  for  large  enough  x,  given  any  control  magmtude. 


Definition  2.2  A  smooth  function  F  :  R"  — ^  R>o  is  called  an  ISS-Lyapunov  function  for 
system  (4)  if  there  exist  Xioo-functions  01,02,  and  Xi-functions  03  and  x,  such  that 


oi(iei)  <  no  <  «2(i^i) 

(6) 

for  any  ^  G  R"  and 

vF(o-/(o  m)  <  -«3(iei) 

(7) 

for  any  ^  G  R"  and  any  ^  G  R”* 

so  that  1^1  >  x(Im1)- 

□ 
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Observe  that  if  V  is  an  ISS-Lyapunov  function  for  (4),  then  F  is  a  Lyapunov  function,  in 
the  usual  sense,  for  the  autonomous  system  i  =  /(x,  0)  obtained  when  no  controls  are  apphed. 

Given  a  closed  invariant  set  A.  that  is,  a  closed  subset  yl  of  R”  with  the  property  that 
traiefctories  for  »  3  0  cannot  exit  this  set  (tor  instance,  {A}  =  0  when  /(0,0)  -  0),  one  can 
define  both  of  the  above  concepts,  ISS  and  ISS-Lyapunov  function,  in  an  entirely  analogous 
manner,  simply  using  distance  to  the  set  instead  of  norms.  This  is  done  for  instance  in  120|, 

and  we  omit  details  here. 


3  Control-Lyapunov  Functions 

As  mentioned  in  the  introductory  section,  a  widespread,  but  typically  ad-hoc,  techmque  in 
nonlinear  control  (as  weU  as  in  related  areas)  reUes  on  the  use  of  “energy  functions  that  can  be 
made  to  decrease  pointwise  by  means  of  instantaneous  controls.  Somewhat  more  techmc^y,  one 
assumes  given  a  positive  definite  and  proper  (=radiaJly  unbounded)  scalar  continuous  function 
7  of  states,  with  the  property  that  1/  can  be  made  to  decrease  infimtesimaily  by  appropriate 
choice  of  controls.  Then  the  control  applied  at  each  instant  is  one  that  forces  this  decrease. 
Of  course,  stated  in  this  informal  manner  there  are  all  kinds  of  technical  comphcations  -one 
needs  a  careful  definition  of  “infinitesimal  decrease”  and  it  is  not  clear  that  a  reasonably  regular 
control  selection  should  exist.  But  the  paradigm  is  extremely  powerful,  and  undehes  not  only 
feedback  control  design  but  also  the  optimal  control  approach  of  Bellman  and  even  artifici^ 
intelligence”  techniques  (position  evaluations  in  games,  “critics”  in  learmng  programs).  Sue 
functions  F  are  genericaUy  called  control-Lyapunov  functions,  in  analogy  to  the  Lyapunov 
functions  classical  in  dynamical  systems  (when  no  control  is  present). 

One  way  to  make  the  above  procedure  effective  computationally  is  if  the  function^  V  is 
differentiable.  In  that  case,  the  condition  of  infinitesimal  decrease  can  be  expressed  simp  y 
as  the  requirement  (the  “clf  property”)  that  for  each  nonzero  x  there  be  some  control  v^ue 
u  e  in'"  so  that  VV{x)f{x,u)  <  0.  (This  is  if  the  objective  is  state-feedback  stabihzation 
to  the  origin;  an  alternative  is  to  ask  that  this  expression  be  uniformly  negative  away  from  a 
desired  set  A,  for  stabilization  to  A,  or  for  instance  that  the  control  should  depend  on  a  fixe 
measurement  function  of  x,  for  output  feedback  questions.  To  avoid  complicating  the  exposition, 
we  continue  this  discussion  with  stabihzation  to  the  origin.)  In  the  early  1980s,  Artstein  and  the 
PI  produced  independent  and  mathematically  complementary  theoretical  justifications  of  this 
technique  (the  former  work  assumed  more  regularity;  the  latter  required  less  smoothness  but 
apphed  more  generahy).  In  1989  the  PI  gave  a  systematic  methodology  for  the  use  of  smooth 
control-Lyapunov  functions,  resulting  in  “universal  formulas”  reviewed  briefiy  below. 


Universal  Formulas 


This  work  is  especially  easy  to  understand  in  the  particular  case  of  system  affine  in  controls, 
those  as  in  Equation  (3).  For  simpheity,  we  assume  that  there  is  just  a  scalar  control  (m  -  ), 
so  G(x)  =  9{x)  is  just  a  column  vector.  For  such  a  system,  the  clf  property  is  triviaUy  shown 

to  be  equivalent  to: 


n(  ^  0 


where  we  are  denoting  the  lie  derivatives  as  a(i)  :=  VV'(i)./o(x),  M*) 

the  other  hand,  giving  a  feedback  law  «  =  *:(»)  for  ‘be  original  system,  with  the  property  that 
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the  same  F  is  a  Lyapunov  function  for  the  obtained  closed-loop  system  x  -  Mx)  +  k(x)g(x) 
is  equivalent  to  asking  that  W(x).(Mx)  +  k{x)g{x))  <  0,  that  is, 

a(a:)  +  k{x)b{x)  <  0 

for  aU  nonzero  x.  Thus  finding  a  suitable  feedback  law  reduces  to  a  problem  of  finding  con¬ 
tinuous  selections.  The  late- 1980s  work  by  the  PI  wasbased  on  the  Mowing  observation,  the 
condition  (8)  is  equivalent  to  the  statement  that  the  pair  (a(x),6(x))  is  stabilizable  seen  as  a 
one-dimensional  parametric  family  of  systems.  And  the  condition  on  k(x)  is  that  seen  as  a  1  x 
matrix,  it  must  be  a  constant  linear  feedback  stabilizer  for  (a(x),  6(x))  for  each 
a  Riccati  equation  for  a  simple  Unear-quadratic  problem  shows  that  the  foUowmg  feedba  . 
k  •=  -(a  +  Va2  +'F)/b  (with  k(x)  :=  0  when  b(x)  =  0)  works.  This  is  in  fact  analytic,  even  al¬ 
gebraic,  on  a,  b.  (The  apparent  singularity  due  to  division  by  6  is  rem^e.)  Along  trajectones 

of  the  corresponding  closed-loop  system,  one  ha^  that  dV/dt  =  +  ^  <  0  ^/^nrLrtv” 

feedback  law  may  fail  to  be  continuous  at  zero,  but  under  a  natural  smaU  control  property 
o“e  1  obtain  continuity  at  the  origin  an  weU.  Since  the  existence  of  a  clf  .s  also  necess^y 
whenever  there  is  any  continuous  feedback  stabilizer  (this  is  an 

classical  Lyapunov  converse  theorems),  one  has  a  necessary  and  sufficient  conffition  for  the 
existance  of  such  teedbadk,  together  with  an  expUcit  tomula  for  feedback  controls  once  tha  a 
df  is  found.  The  formula  shown  above  is  an  example  of  what  we  mean  by  a  umver^  form 
in  the  context  of  clf’s,  meaning  in  general  an  analytic  function  of  Lie  derivatives  wk-ch,  when 
substituting  a  df,  provides  a  global  stabilizer  (there  is  also  an  extra  techmcal  reqmrement  to 
guarantee  continuity  at  the  origin,  which  we  omit  in  this  overview;  the  references  should 
consulted  for  details). 

Since  clf’s  are  as  a  general  rule  easier  to  obtain  than  the  feedback  laws  themselves  -aft^er 
aU  in  order  to  prove  that  a  given  feedback  law  stabiUzes,  one  typicaUy  has  to  exkbit  a  smtable 
J^apunov  function  anyway-  these  techniques  provide  in  principle  a  very  powerful  approach  o 
nonlinear  stabilization.  In  any  case,  the  availability  of  universal  formulas  aRows  the  search  to 
be  confined  to  just  one  scalar  function,  and  could  be  the  basis  of  numeric^  approaches_  Tbs 
had  been  observed  before  by  the  PI,  but  never  implemented.  A  paper  at  the  1993  CDC 
Long  and  Bayoumi  provided  one  such  experimental  approach,  using  the  formulas  as  a  basis  of 

a  numerical  technique. 

Another  important  direction  is  in  extending  universal  formulas  to  the  case  where  the  contro 
value  set  is  constrained.  In  work  with  his  graduate  Lin,  the  PI  found  formulas  for  bounded 
controls  (see  [3])  as  well  as  nonnegative  scalar  controls  ([15]). 


Non-Smooth  Cases 

In  an  early  (1983)  paper,  the  PI  had  shown  that  asymptotic  controUablility  -which  is  the 
minimal  possible  condition  for  stabiUzability-  is  sufficient  to  insure  the  eiastence  of  a  con- 
trol  Lyapunov  function  V  which  is  C°  but  not  necessarfiy  smooth;  in  the  defimtion,  deriva¬ 
tives  of  F  are  replaced  by  Dini  derivatives.  Though  this  is  an  extremely  general  result.  D  m 
derivatives  do  not  lend  themselves  to  explicit  checking  of  the  clf_  property.  In  work  recently 
began  with  Lafferriere  (see  the  preliminary  paper  [25]),  we  revisited  this  gener  res 
two  different  points  of  view.  First  of  all,  we  observed  that,  by  generalizing  the  clf 

tion  ‘‘(Vx#0)(3n)[VF(x)/(x,n)  <  0]”  to  “(Vx#0)(3u)(Vp  G  D  ^ , 

D-V(x)  is  the  subdifferential  of  F  at  x,  the  same  existence  result  holds.  The  proof  fai  y 
Lghtforward,  since  the  function  F  was  obtained  in  the  1983  Pi’s  paper  from  an  optimal 
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control  problem,  and  via  a  standard  calculation  it  foUows  that  then  V  must  be  a  viscosity 
supersolution  of  the  associated  Hamiiton-Jacobi-Bellman  equation,  from  which  the  clf  property 
follows.  Unfortunately,  this  result  is  less  interesting  than  it  may  appear  at  first  sight,  since 
there  is  no  guarantee  than  V  be  Lipschitz,  and  in  particular  the  sub  differential  could  be  empty, 
and  work  in  this  area  is  still  in  progress. 

A  second,  and  from  an  immediate  appUed  point  of  view  more  interesting,  aspect  aspert 
of  our  current  work  with  Lafferriere  is  the  study  of  clf’s  V  which  are  piecewise  smooth.  T^s 
fits  very  nicely  with  work  of  Canudas  and  others  in  practical  control  problems  (in  particular 
in  robotics)  as  well  as  work  such  as  that  recently  reported  by  Helton  on  piecewise  quadratic 
cost  functions.  For  these  U,  obtained  by  “pasting  together”  smooth  ones,  the  verification  of 
the  Lyapunov  property  can  be  carried  out  using  gradients,  just  as  m  the  smooth  case.  The 
main  contribution  of  [25]  is  to  give  conditions  under  which  the  same  umversal  formula  given 
earlier  produces  for  such  a  U  a  piecewise  continuous  globally  stabilizing  feedback  law.  (In  our 
case  the  feedback  turns  out  to  be  continuous  at  the  origin  and  smooth  everywhere  except  on 
a  hypersurface  of  codimension  1.)  In  particular,  a  classical  example  due  to  Artstein  for  which 
it  is  known  that  no  differentiable  clf  (and  no  continuous  feedback)  exists  is  treated  exphcitly 
and  a  control  law  is  derived  for  it  automatically  from  the  universal  formula  rather  than  m  an 

ad-hoc  manner. 


4  Numerical  Methods  for  Steering  Nonlinear  Systems 

This  part  of  the  report  deals  with  the  problem  of  numerically  finding  controls  that  achieve  (at 
least  approximately)  a  desired  state  transfer.  That  is,  for  any  given  initial  and  target  states 
and  in  one  wishes  to  find  a  time  T  >  0  and  a  control  u  defined  on  the  interval  [0,rj,  so 
that  u  steers  sufficiently  close  to  for  the  system  (1). 

In  particular,  it  is  of  interest  to  consider  the  case  of  systems  without  drift,  that  is,  systems  for 
which  the  right-hand  side  is  linear  (not  affine)  in  u,  so  the  equations  take  the  form  x  -  G{x)u. 
For  such  systems  it  is  relatively  straightforward  to  decide  controllability,  since  it  is  eqmva- 
lent  to  the  standard  Lie  algebra  rank  condition,  but  the  design  of  expficxt  control  strategies 
has  attracted  considerable  attention  lately.  Problems  of  steering  systems  without  drift  are  in 
part  motivated  by  the  study  of  nonholonomic  mechanical  systems.  Many  sophisticated  control 
strategies  have  been  proposed,  based  on  a  nontrivial  analysis  of  the  structure  of  the  Lie  ^geora 
of  vector  fields  generated  by  the  columns  of  G  by  many  authors.  The  approach  presented  in  the 
PI’S  paper  [22]  was  of  an  entirely  different  nature;  it  is  essentiaUy  a  simple-minded  algorithm, 
in  the  style  of  classical  numerical  methods  as  in  Bryson  and  Ho’s  classical  book  and  m  its 
simplest  form  requires  almost  no  effort  to  implement  in  a  high-level  language.  Mathematic^y, 
the  main  contribution  of  the  Pi’s  work  in  this  area  was  is  in  the  formulation  of  the  so-called 
“generic  nonsingular  loop”  approach  and  the  justification  of  the  algorithm.  The  latter  re^hes 
on  a  new  result  proving  the  existence  (and  genericity)  of  such  loops  with  good  controUabihty 
properties.  This  approach  was  motivated  to  a  great  extent  by  related  work  on  time  varying 
feedback  laws  by  the  French  school  during  the  past  two  years,  especially  Coron  there  and  m 
[22].  The  journal  version  of  [22]  has  recently  been  accepted  for  the  IEEE  Transactions  ([14]) 
and  contains  a  worked-out  numerical  example. 


4 


NUMERICAL  METHODS  FOR  STEERING  NONLINEAR  SYSTEMS 


15 


The  Basic  Idea 

Assume  that  /  is  continuously  differentiable  (later  we  wiU  need  to  assume  analytidty).  GWen 
a  state  fo  6  IR”  and  a  measurable  and  locaUy  essentiaUy  bounded  control  u  :  [0,rj  ^  IR  so 
that  the  solution  x  :  [0,T]  ^  H"  of  the  equation  (3)  with  this  control  and  the  imd^^  condition 
x(0)  =  fo  is  defined  on  the  entire  interval  [0,T],  the  state  x(t)  at  time  t  €  [0,T]  is  denoted 
by  (p(t,£o,u).  As  discussed  above,  the  objective,  for  any  given  initial  and  target  states  fo  and 
fF  in  IR"  is  to  find  a  time  T  >  0  and  a  control  u  defined  on  the  interval  [0,T],  so  that  u 
steers  fo  to  f^,  that  is,  so  that  <^(T,fo,ti)  =  fF,  at  least  in  an  approxiinate  sense^  After 
a  change  of  coordinates,  one  may  assume  without  loss  of  generality  that  f^  =  0-  Classic^ 
numerical  techniques  for  this  problem  are  based  on  variations  of  steepest  descent.  This  is  aU 
very  elementary,  but  we  need  to  recall  it  for  further  reference.  The  basic  idea  is  to  start  with 
a  guess  of  a  control,  say  u  :  [0,T]  -  IR”*,  and  to  improve  iteratively  on  this  imtial  guess  More 
precisely,  let  x  =  </>(-,  fo,  il).  If  the  obtained  final  state  x(r)  is  already  zero,  or  ^s  sufficie^ 
zero  the  problem  has  been  solved.  Otherwise,  we  look  for  a  perturbation  Au  so  that  the  new 
control  u  +  Au  brings  us  closer  to  our  goal  of  steering  fo  to  the  origin.  The  various  techmques 
differ  on  the  choice  of  the  perturbation;  in  particular,  two  possibilities  are  found  most  often. 

The  first  one  is  basicaUy  Newton’s  method,  and  proceeds  as  follows.  Denote,  for  any  fixed 
initial  state  fo,  «(«)  :=  </>(T,fo,t^)  thought  of  as  a  partially  defined  map  from  £^(0^)  into 
IR"  This  is  a  continuously  differentiable  map.  Theorem  1),  so  expanding  to 
results  a(u  +  v)  =  a(u)  +  a.[u](u)  +  o(v)  for  any  other  control  u  uniformly  near  u  (  *  as  a 
subscript  denotes  differential).  If  we  can  now  pick  v  so  that 


a,[«](t>)  =  -a(u) 


then  for  small  enough  h  >  0  real. 


a(u  +  hv)  =  (1  —  h)a(u)  4-  o(h) 


(9) 


(10) 


WiU  be  smaUer  than  the  state  a(n)  reached  with  the  initial  guess  control  u.  In  other  words,  the 
choice  of  perturbation  is  Au  :=  hv,  0  <  h  <  1.  It  remains  to  solve  equation  (9)  for  u.  The 
operator  L  :  v  ^  a.[u]{v)  is  the  one  corresponding  to  the  solution  of  the  vanatioii^  equation 
(linearization  along  trajectory)  z  =  A{t)z  +  B{t)v,z{0)  —  0,  where  A{t)  ),u(  ))  an 

Bit)  :=  for  each  t,  that  is,  Lv  =  /J’  ^T,s)B{3)v{s)ds  ,  where  $  denotes  the 

fundamental  solution  associated  to  A  =  A{t)X.  The  operator  L  maps  ^ 

it  is  onto  when  the  Unearization  is  a  controRable  Unear  system  on  the  interval  [0,rj,  that  is, 
when  u  is  a  control  nonsingular  for  fo  relative  to  the  system  (3).  In  other  words,  ontoness 
of  X  =  a.[u]  is  equivalent  to  first-order  controUabUity  of  the  origin^  nonUnear  system  ^ong 
the  trajectory  corresponding  to  the  initial  state  fo  and  the  control  u.  The  mam  point  of  our 
technique  Ues  in  showing  that  it  is  not  difficult  to  generate  useful  nonsingular  controls,  at  least 

for  systems  with  no  drift. 

Assuming  nonsingularity,  there  exist  then  many  solutions  to  (9).  Because  of  its  use  m  (10) 
where  a  small  u  is  desirable,  and  in  any  case  because  it  is  the  most  natural  choice,  it  is  reasonabk 
to  pick  the  least  squares  solution,  that  is,  the  unique  solution  of  mimmum  norm,  u  X  a(u) 

where  L*  denotes  the  pseudoinverse.  The  technique  sketched  above  is  weU-known  m  numerical 
control.  For  instance,  the  derivation  in  pages  222-223  of  Bryson  and  Ho’s  book,  when  apphed 
to  solving  the  optimal  control  problem  having  the  trivial  cost  criterion  J{u)  =  0  and  subject  to 
the  final  state  constraints  x  =  Tp{x)  =  0,  results  in  this  formula. 
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Alternatively,  instead  of  solving  (9)  for  v,  one  might  use  the  steepest  descent  choice  v 
-ra(u)  where  is  the  adjoint  of  i.  This  formula  also  results  from  the  above-cited  derivatmn, 
now  when  appUed  using  the  quadratic  cost  J(u)  =  but  relaxing  the  terimnal  constraints 

(i,  =  0).  Now  a(u  +  hv)  =  (I  -  hLL’)a(u)  +  o(h),  where  I  is  the  identity  operator  If  again  X  is 
onto,  that  is.  if  the  control  u  is  nonsingular  for  6,  then  the  symmetric  operator  LL  is  positive 
definite,  so  0  <  h  «  1  will  give  a  contraction  as  earUer.  (An  advantage  of  using  X  instead 
of  L*  is  that  no  matrix  inversion  is  required.  On  the  other  hand,  one  may  expect  New  on  s 
method  to  behave  better  locaUy  and  steepest  descent  to  be  more  effective  globaUy.) 

Of  course,  in  general  there  are  many  reasons  for  which  the  above  classical  techmques  may 
fail  to  be  useful  in  a  given  application:  the  initial  guess  u  may  be  singular  for  ^o,  the  iteration 
may  fail  to  converge,  and  so  forth.  The  main  point  of  the  Pi’s  recent  work  was  to  show 
that,  for  a  suitable  class  of  systems,  a  procedure  along  the  above  lines  can  be  guaranteed  to 
work.  More  specifically,  we  showed  that  for  analytic  systems  without  drift  there  are  alway^ 
controls  u  with  the  property  that  they  lead  to  “nonsingular  loops”  in  the  sense  that:  (1)  u 
is  nonsinguiar  for  every  state  x,  and  (2)  4>{T.x,u)  =  x  for  all  x.  The  result  is  even  more 
general:  for  aU  analytic  systems  that  have  the  strong  Lie  accesibility  property  (no  assumption 
that  the  system  has  no  drift),  there  exist  controls  that  are  nonsingular  for  all  states.  Even  more 
interestingly,  generic  controls  (in  the  standard  topology  sense)  have  this  property  From 
here,  one  obtains  the  result  for  systems  without  drift:  stating  from  such  a  control  a;,  defined 
on  an  interval  [0,r/2],  one  may  now  consider  the  control  u  on  [0,  T]  which  equals^  on  [0  /  ] 

and  is  then  Mowed  by  the  antisymmetric  extension:  u{t)  =  -oj{T  -  t),t  e  [1  /^,i  J-  ims 
provides  nonsingular  loops.  (The  proof  of  the  existence  and  genericity  of  nonsingular  controls 
proceeds  by  first  establishing  the  existence  of  nonsingular  controls  pointwise  -  a  topological 
Led  point  theorem  is  needed  here-  and  then  by  dualizing  Sussmann’s  umversal  input  theorem 
for  observabiUty,  which  provides  the  required  transversality  result.)  In  [22]  we  also  provide  a 
convergence  theorem  that  shows  that,  assuming  u  is  picked  as  above,  repeated  apphcation  of 
the  Newton  or  gradient  algorithm  starting  from  any  fixed  ball  is  guaranteed  to  get  us  wi  n 
any  desired  epsilon-distance  of  the  target  state,  for  all  small  enough  stepsizes  h;  a  rate  of 
convergence  estiate  is  provided  as  well. 

It  is  possible  to  combine  the  nonsinguiar  loop  technique  with  line  searches  over  the  scalar 
parameter  h  or,  even  more  efficiently  in  practice,  with  conjugate  gradient.  Line  search  corre¬ 
sponds  to  leaving  t;  fixed  and  optimizing  on  the  step  size  h,  only  recomputing  a  variation  u  when 
no  further  improvement  on  h  can  be  found.  (The  control  applied  at  this  stage  is  then  the  one 
for  the  “best”  stepsize,  not  the  intermediate  ones  calculated  during  the  search.)  The  planmng 
of  motions  with  workspace  obstacles  is  another  interesting  and  important  area.  We  proposed 
paper  a  method  that  aUows  including  obstacles,  essentially  by  multiplying  the  equations  by 
a  function  which  vanishes  at  the  sets  that  are  dissallowed  for  trajectories  (this  is  somewhat 
related  to  the  “potential”  method  in  path  planning). 


5  Other  Topics 

In  this  section  three  other  areas  are  discussed  that  represent  recent  work  by  the  PI  supported 
by  this  grant. 
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Discrete-Time  Systems 

Another  thread  of  the  Pi’s  work  focuses  on  controllability  properties  of  discrete-time  nonhnear 
systems.  These  are  described  by  controUed  difference  equations  of  the  Mowing  general  form: 

x(t+ 1}  =  ,  t  =  0,l,2,....  (11) 

The  sequences  x  and  u  take  values  in  manifolds.  Observe  that  both  variables,  the  control  u 
and  the  state  x,  take  continuous  values,  which  distinguishes  this  study  from  classical  automata 
theory.  In  contrast  to  the  linear  case,  where  discrete  and  continuous- time  systems  are  treated 
side  bv  side,  much  of  the  Uterature  regarding  nonlinear  systems  has  classically  restricted  itself 
to  the  analysis  of  the  latter,  namely,  to  the  consideration  of  systems  (1).  With  the  exception  of 
ad-hoc  studies  for  special  classes  of  systems,  seldom  are  nontrivial  results  provided  for  ^screte- 
time  models,  in  spite  of  the  fact  that  the  latter  arise  very  naturally  m  several  contexts.  This 
lack  of  study  can  be  ascribed  mostly  to  the  lack  of  powerful  geometric  tools  of  analysis,  when 
compared  with  the  highly  successful  use  of  such  techniques  in  the  context  of  continuous-time 

problems. 

One  of  the  main  sources  of  discrete-time  questions  in  appUcations  arises  from  time  sampUng 
in  digital  control.  This  is  analogous  to  the  consideration  of  “time  1  maps”  m  th^e  study  o 
uncontroUed  differential  equations.  As  far  as  a  control  algorithm  is  concerned,  the  physic 
system  is  a  discrete-time  system  described  by  an  equation  of  the  type  (11),  where  now  /(x  u 
is  the  solution  of  the  differential  equation  (1)  at  the  end  of  the  sampUng  interval  assuming  that 
the  initial  state  was  x  and  the  control  was  held  constantly  equal  to  u.  (There  are  of  course 
variations  of  the  basic  sampling  idea:  A/D  conversion  involves  also  quantization,  constant 
controls  values  may  be  smoothed  out  by  a  fUter  before  being  appUed,  multi-rate  strategies 
are  popular;  but  even  without  these  complications,  the  study  of  discrete-time  control  systems 
appears  naturally.)  Another  area  in  which  results  from  discrete-time  nonlinear  control  theory 
axe  of  importance  is  in  the  study  of  Markovian  systems  (11)  where  the  variables  u(t)  are  random, 
and  together  with  the  transitions  /  they  characterize  the  probabilistic  behavior  of  the  process 
x(.).  Reachability  properties  play  a  central  role  in  estabUshing  the  existence  and  smoothness 
prop6rtiGS  of  ecjuilibriuin  distributions,  ns  in 

In  late-1980s  work  with  Jakubczyk,  and  in  other  work  together  with  various  coUaborators, 
most  especiaUy  with  his  student  Albertini,  the  PI  Mowed  an  approach,  based  on  the  introduc¬ 
tion  of  certain  Lie  algebras  of  vector  fields,  which  permits  obtaimng  results  for  discrete  time 
which  closely  parallel  some  of  those  results  known  in  the  differential  equation  case.  Roughly, 
the  necessary  vector  fields  are  obtained  by  considering  the  infinitesimal  effect  of  iterations  of 
the  mappings  /(-,  u).  Formally,  if  instead  of  these  iterates  based  on  control  sequences  would 
instead  be  considering  actions  of  a  Lie  group  G  on  a  manifold,  our  vector  fields  wodd  be  the 
standard  infinitesimal  generators  associated  to  the  elements  in  the  Lie  algebra  of  G.  Armed 
with  these  tools,  the  PI  and  coworkers  obtained  new  results  on  controUability  properties^. 

For  a  system  (1)  or  (11),  the  reachable  set  or  forward-accessible  set  from  a  state  x°  6  X 
consists  of  those  states  to  which  one  may  steer  x°  using  arbitrary  -me^urable  essen  lally 
bounded  in  the  continuous-time  case-  controls.  The  orbit  or  forward-backward  access^ble  set 
from  x°  is  defined  a^  the  set  consisting  of  all  states  to  which  x°  can  be  steered  using  both 
motions  of  the  system  as  weU  as  negative  time  motions.  Negative  time  motions  are  in  gener 
not  physically  realizable,  but  the  orbit  is  an  extremely  useful  object  to  study,  as  it  is  always 
a  submanifold  of  X  whose  dimension  can  be  obtained  from  Lie-algebraic  computations,  a 
group-theoretic  techniques  are  relevant.  In  contrast,  the  reachable  set  is  not  in  general 
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manifold,  though  one  may  define  a  “dimension”  for  it  in  various  natural  and  equivalent  ways, 
for  instance  meaning  the  largest  dimension  of  a  submanifold  that  it  includes. 

Controllability  questions  for  continuous-time  systems  have  been  the  subject  of 
search.  In  continuous-time,  a  fundamental  fact  in  controUabiUty  studies  is  what  may  be  called 
the  Chow-Krener  (*)  property:  The  dimension  of  the  orbit  from  each  x  £X  equals  the  dimen¬ 
sion  of  the  reachable  set  from  xT  (The  property  holds  as  stated  for  analytic  systems;  m  the 
more  general  smooth  case  one  would  need  an  addditional  Lie-algebraic  assumption.)  That  is, 
the  reachable  set  contains  a  submanifold  of  the  state  space  and  it  is  in  turn  contained  in  a  sub¬ 
manifold  of  the  same  dimension,  and  this  dimension  can  be  computed  from  the  rank  of  certain 
matrices  formed  by  taking  iterated  Jacobians  of  the  vector  fields  defining  the  system,  evaluated 
at  the  state  1°.  These  Lie-theoretic  characterizations  are  “direct”  in  that  they  do  not  involve 
integration  of  the  differential  equation,  and  they  are  closely  related  to  more  classical  geometric 
material  related  to  Frobenious’  theorem.  Perhaps  the  most  important  difference  between  (11) 
and  (1)  is  that  the  (*)  property  fails  for  the  former,  even  for  systems  obtained  through  the 
sampling  of  one-dimensional  analytic  systems. 

The  Pi’s  work  with  Jakubczyk  dealt  with  systems  (11)  that  are  time-reversible  or  invertible, 
that  is,  the  maps  f{;u)  are  diffeomorphisms.  (This  is  satisfied  for  systems  that  arise  from  the 
sampling  of  complete  continuous- time  systems.)  For  such  systems,  the  paper  derived  several 
characterizations  of  accessibUity  and  studied  the  geometric  structure  of  accessible  sets,  and  ^ 
a  consequence  a  theorem  was  proved  showing  that  the  (*)  property  does  hold  provided  that  the 
state  x^  be  an  equihbrium  state  (/(i*^,0)  =  i  ). 

Much  further  progress  has  now  been  achieved  in  work  with  Albertini;  see  [5], [6]  and  several 
conference  papers  published  recently.  Among  results  in  this  very  recent  work  are  the  extension 
of  the  (*)  property  to  many  cases.  For  example,  (*)  holds  for  each  state  x  that  satisfies  a 
positive  Poisson  stabiHty  condition.  (An  equilibrium  point  satisfies  this  requirement,  so  the 
previously-known  result  is  generalized.)  It  was  also  possible  to  prove  that  (*)  does  hold  if  the 
orbit  from  a:°  is  compact.  Moreover,  it  was  shown  that  transitivity  implies  forward  accessibmty 
when  there  exists  a  transitive  state  x  which  is  also  a  global  attractor  for  the  given  system  (i.e. 
X  e  clos  (R(x))  for  each  state  x).  Another  interesting  result  was  the  proof  that  the  set  of  points 
for  which  property  (*)  does  not  hold  is  very  thin.  In  fact,  it  was  established  that  if  there  is 
only  one  orbit  (the  system  is  transitive),  then  forward  accessibUity  holds  from  an  open  dense 
set  of  states,  assuming  the  state  space  to  have  at  most  finitely  many  connected  components. 

To  prove  these  new  results,  one  must  associate  to  (11)  various  new  Lie  algebras  of  vector 
fields  whose  orbits  are  correlated  to  the  geometry  of  the  sets  R(x)  and  0(x),  providing  new  Lie- 
theoretic  characterizations  of  the  transitivity  and  the  forward  accessibility  properties.  This  work 
also  generalized  several  results  to  a  larger  class  of  systems,  where  the  invertibUity  assumption 
was  relaxed  in  various  ways.  More  precisely,  it  dealt  with  partially  defined  dynamics,  systems 
for  which  the  functions  {/(•,«)}  are  diffeomorphisms  but  possibly  defined  only  on  some  open 
subsets  of  the  state  space,  and  also  covered  was  the  “submersive”  case,  systems  for  which  the 
Jacobian  of  the  function  f(;u)  has  full  rank  at  each  point.  Unfortunately,  for  both  classes 
many  of  the  interesting  results  that  hold  in  the  invertible  case  do  not  longer  hold;  however, 
one  can  stUl  give  some  theoretic  characterizations  of  transitivity  and  forward  accessibUity.  Also 
given  were  several  examples  showing  the  pathological  behavior  that  can  arise  in  these  cases, 
and  the  main  differences  with  the  invertible  case  were  described. 

Another  aspect  of  the  Pi’s  and  Albertini’s  work  dealt  with  connections  between  controUabU- 
ity  of  a  given  system  and  properties  of  an  associated  classical  (uncontroUed)  dpamical  system. 
Recently,  Colonius  and  Kliemann  introduced  the  notion  of  controllability  subsets  of  the  state 
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space  of  coatinuous-time  systems.  These  are  essentiaUy  sets  where  “ almost  reachabihty  holds 
ControUability  sets  have  proved  to  be  an  extremely  useful  concept;  m  partic^ar,  Colomu^s  an 
KUemann  have  estabUshed  an  interesting  relationship  between  such  sets  and  chaotic  behavior 
in  subsets  of  an  associated  dynamical  system.  This  work  obtained  analogs  of  these  results  in 
the  discrete-time  setting.  This  extension  is  not  trivial,  as  it  depends  critically  on  the  deep  un¬ 
derstanding  of  the  forward  accessibility  properties  of  controUability  sets,  m  fact  the  basic  idea 
which  underUes  most  of  the  results  is  the  validity  of  property  {*)  for  continuous-time  models. 


Identification  Questions 

The  question  of  dynamical  systems  identification  from  input/output  data  is  at  the  core  of 
control  theory,  mostly  in  ‘black  box’  approaches,  where  only  qualitative  a  prion  information  is 
available  about  the  process  being  controUed.  (In  other  areas,  such  as  in  the  study  of 
of  attractors  for  unforced  dynamical  systems,  analogous  issues  appear  but  mathematicaUy  the 
availability  of  inputs  makes  this  a  different  topic;  in  particular,  problems  of  choice  of  controls 
-persistent  excitation  and  related  concepts-  take  center  stage  in  control  theory.)  Since  his  thesis 
work  in  the  mid  1970s,  the  PI  has  had  a  continuing  interest  in  a  problem  which  is  basic  m  this 
context,  namely,  the  generalizations  to  nonlinear  systems  of  the  correspondence  that  exists  in 
the  linear  case  between  “autoregressive  moving  average”  representations 

=  aiy{t)  +  ...  +  +  •  •  •  + 

(or  in  frequency-domain  terms,  rationality  of  transfer  functions)  and  state-space  representa¬ 
tions.  In  the  Unear  case,  such  representations  form  the  basis  of  much  of  adaptive  control  ^d 
identification  theory.  The  obvious  generaUzation  is  to  look  at  “input  output  equations  of  the 

=  0  (13) 

where  w(-)  =  («(•),  y{-))  represent  the  i/o  pairs  of  the  system,  connected  by  an  operator  F  that 
maps  input  functions  n  to  output  functions  y  =  F[u].  (If  an  initial  state  is  not  fixed,  one  has  a 
fanuly  of  such  operators,  one  for  each  initial  state.)  In  experiments,  the  functional  relation  E 
is  usually  estimated,  for  instance  through  least  squares  techniques,  if  a  parametric  general  form 
is  chosen,  such  as  using  polynomials  of  a  fixed  degree.  A  siimlar  formalism  ca^  be  developed 
for  discrete-time  systems,  using  difference  equations  instead;  actuaUy,  the  discrete-time  case 
had  been  already  developed  by  the  PI  as  part  of  his  thesis  work,  and  it  has  been  cited  as  a 
justification  of  identification  algoritliins  by  several  other  authors. 

In  work  with  his  former  graduate  student  Wang,  the  PI  has  extended  to  continuous-time 
the  results  obtained  earUer  by  the  PI  for  the  discrete  case;  see  especially  [1].  This  work,  closely 
related  and  complementing  studies  by  Crouch,  Glad,  Van  der  Schaft,  ^d  of^^rs,  succ^ded  in 
showing  that,  if  one  knows  that  the  data  is  generated  by  a  well-posed  operator  F ,  then 
is  an  algebraic  i/o  equation  (i.e.,  all  pairs  («,F[n])  satisfy  (13))  if  and  only  tfii 
by  a  (singular)  state  space  polynomial  system  (Precise  definitions  are  given  m  the  above-given 
references  )  By  “weU-posedness”  it  is  meant  that  F  is  a  Fltess  operator,  i.e.  one  described 
by  a  convergent  generating  series.  The  i/o  operators  induced  by  convergent  generating  series 
form  a  very  general  class  of  causal  operators,  capable  of  representmg  a  variety  of  i^onhne^ 
systems.  In  [2],  the  algebraic  results  are  supplemented  by  a  result  Hnkmg  andy  ic  i/o  equa  i 
to  local  internal  realizability.  To  do  this,  one  first  constructs  a  ‘meromorphic  relation  by 
studying  the  properties  of  meromorphically  finitely  generated  field  extensions,  and  then  impos 
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similar  properties  on  the  observation  fields  already  introduced  in  the  former  paper  Finally, 
by  a  perturbation  approach,  together  with  the  FUess  Lie  rank  condition  for  reahzabihty,  one 
cLclu^des  that  around  each  point  there  is  local  analytic  realization.  That  paper  combines  the 
techniques  from  differential  algebra  used  in  the  polynomial  case  with  techmques  from  differential 

geometry  (Lie  rank  finiteness). 

Central  to  this  work  Is  the  analysis  of  o6sem.ton  spaces.  One  of  the  critical  technical  resdts 
used  relates  two  different  definitions  of  this  space,  one  in  terms  of  smooth  controls  and  another 
in  terms  of  piecewise  constant  ones.  The  first  definition  immediately  relates  to  i/o  equations, 
while  the  other  is  related  to  realizability;  these  two  definitions  were  shown  to  coincide  in  a 
1989  paper  with  Wang.  The  papers  [17]  and  (21]  started  the  study  of  .ntepraf  as  opposed 
to  differential  algebraic  equations.  For  Unear  systems,  it  is  standard  to  prefilter  data,  whic 
amounts  precisely  to  using  with  less-noisesensitive  integral  equations.  For  nonlmear  systems, 
similar  motivations  were  proposed  by  A.E.  Pearson.  In  the  Unear  case,  differential  equations 
are  always  equivalent  to  integral  ones,  but  it  was  shown  in  the  above  papers  that  this  is  not 
necessarUy  the  case  in  general;  several  relationships  between  the  two  tpes  of  representations 
are  provided.  Another  area  deals  with  non-polynomial  (and  non-rational)  reahzabihty.  In 
the  textbook  by  Nijmeijer  and  van  der  Schaft  it  was  shown  that,  under  strict  constant  rank 
conditions,  the  outputs  of  a  smooth  state  space  system  can  be  described  by  ^  equation  of 
type  (13)  for  which  E  is  a  smooth  function.  In  the  polynomial  case,  these  conditions  are  not 
needed,  and  the  converse  holds  too.  In  the  analytic  case,  if  there  is  an  equation  then  there 
is  a  reaUzation,  but  in  principle  the  converse  does  not  hold  (unless  there  are  nonsmgulaji  y 
conditions).  That  is,  there  are  analytic  systems  and  initial  states  for  which  the  correspon  g 
i/o  operators  satisfy  no  possible  analytic  equation.  It  is  possible  that  there  are  parti^  converses 
to  the  above  results,  however.  One  possibiUty  is  to  consider  the  mapping  sending  vectors 
(x  u(0)  u'(0),...,u(’*“^K0))  .  consisting  of  states  and  (n  -  l)-jets  of  inputs  into  n-jets  of 
Id  (n  -i)-jet=  of (,(0)  V'(O), . . y'“)(0),  o(0),.'(0),  ■  •  f '  >(0))  ^This  -p 
is  analytic,  and  hence  the  image  of  each  compact  set  is  a  finite  union  of  embedded  submamfolds 
(from  results  in  subanalytic  set  theory).  This  impUes  that,  for  bounded  states  and  bounded 
controls  (in  an  appropriate  Whitney  topology),  a  finite  number  of  local  analytic  equations  (as 
opposed  to  a  single  global  equation)  are  satisfied  by  i/o  pairs.  PreUminary  work  along  these 
Unes  was  reported  in  work  with  Wang  (again  see  [17],  [21]). 

Our  latest,  and  most  unexpected  result  ([27])  in  this  general  area  showed  the  e^stence  of 
inputs  that  are  sufficiently  rich  to  permit  the  identification  (in  a  purely  theoretmal^sense)  of 
arbitrary  nonlinear  systems.  This  result  constitutes  a  great  generalization  of  the  /^i^ve^al 
input  theorems”  developed  by  Isidori,  Sussmann,  the  author,  and  others  durmg  the  last  20 
years;  a  more  detailed  journal  paper  is  in  preparation. 


Information-based  complexity  ideas 

Fin*  on  the  topic  of  identification,  we  mention  the  work  carried  out  in  the  context  of 
information-baaed  compiexity  In  the  joint  paper  118]-1191,  the  PI  and  coanthora  were  able 
to  extend  to  a  nonlinear  dans  of  “fading-memory  systems”  the  previons  rffitilts  known  regard¬ 
ing  the  number  of  Inputs  needed  for  deterministic  noisy  identification  of  classes  of  stable  hnear 

systems. 
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